Simplify: A Python library for optimizing pruned neural networks

نویسندگان

چکیده

Neural network pruning allows for impressive theoretical reduction of models sizes and complexity. However it usually offers little practical benefits as is most often limited to just zeroing out weights, without actually removing the pruned parameters. This precludes from actual advantages provided by sparsification methods. We propose Simplify, a PyTorch compatible library achieving effective model simplification. Simplified benefit both smaller memory footprint lower inference time, making their deployment embedded or mobile devices much more efficient.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Pruned Neural Networks for Regression

Neural networks have been widely used as a tool for regression. They are capable of approximating any function and they do not require any assumption about the distribution of the data. The most commonly used architectures for regression are the feedforward neural networks with one or more hidden layers. In this paper, we present a network pruning algorithm which determines the number of units ...

متن کامل

Extracting Rules from Pruned Neural Networks for Breast Cancer Diagnosis

A new algorithm for neural network pruning is presented. Using this algorithm, networks with small number of connections and high accuracy rates for breast cancer diagnosis are obtained. We will then describe how rules can be extracted from a pruned network by considering only a nite number of hidden unit activation values. The accuracy of the extracted rules is as high as the accuracy of the p...

متن کامل

DendroPy: a Python library for phylogenetic computing

UNLABELLED DendroPy is a cross-platform library for the Python programming language that provides for object-oriented reading, writing, simulation and manipulation of phylogenetic data, with an emphasis on phylogenetic tree operations. DendroPy uses a splits-hash mapping to perform rapid calculations of tree distances, similarities and shape under various metrics. It contains rich simulation ro...

متن کامل

Simpl: a Python Library for Sinusoidal Modelling

This paper introduces Simpl, a new open source library for sinusoidal modelling written in Python. The library is presented as a resource for researchers in spectral signal processing, who might like to access existing methods and techniques. The text provides an overview of the design of the library, describing its data abstractions and integration with other systems. This is complemented by s...

متن کامل

pylibjit: A JIT Compiler Library for Python

We present pylibjit, a Python library for generating machine code at load time or run time. The library can be used for dynamic code generation, although it is mainly aimed at optimizing compilation of existing Python function definitions. Python functions can be compiled by simply annotating them with a decorator specifying data types. The pylibjit compiler takes advantage of this type informa...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: SoftwareX

سال: 2022

ISSN: ['2352-7110']

DOI: https://doi.org/10.1016/j.softx.2021.100907